Explore the castle walls. The walls are a great way to see the town with good views over both buildings and the harbour.
Visit the old barracks , now maintained by English Heritage. They were built between 1717 and 1721 with a design attributed to Hawksmoor.